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Abstract 

This paper deals with optimal prediction in a regime-switching model driven 
by a continuous-time Markov chain. We extend existing results for geometric 
Brownian motion by deriving optimal stopping strategies that depend on the 
current regime state, and prove a number of continuity properties relating to 
optimal value and boundary functions. Our approach replaces the use of closed 
form expressions, which are not available in our setting, with PDE arguments 
that also simplify the approach of [2] in the classical Brownian case. 
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1 Introduction 

Regime-switching models have been introduced by Hamilton [6] in discrete time and 
are among the most popular and effective risky asset models. The regime-switching 
property is reflected in the changes of states of a Markov chain fit, which stands for 
the influence of external market factors. 


European options have been priced in continuous-time regime-switching models by 
Yao, Zhang and Zhou [15] via a recursive algorithm, and in Liu, Zhang and Yin [8] 
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using the fast Fourier transform. Optimal stopping for option pricing in regime¬ 
switching models has been considered in Guo [4], Guo and Zhang [5], Le and Wang [7], 
and in Ly Vath and Pham [14] with optimal switching. Optimal selling under thresh¬ 
old rules has been dealt with in Eloe et ah [3] in an exponential Gaussian diffusion 
model with regime switching. We refer to Shiryaev [12] and Peskir and Shiryaev [11] 
for background on the characterization of optimal stopping times and rewards. 

The problem of selling a stock at the ultimate maximum has been considered by Du 
Toit and Peskir [2] as an extension of the results of Shiryaev, Xu and Zhou [13]. In 
this paper we extend the result of [2] to the framework of Markovian regime switching. 
Some of our results are natural extensions of those of [2] by averaging over the regime¬ 
switching component, however the regime-switching case presents notable differences 
and additional difficulties compared with the classical Brownian case. For example, 
the optimal boundary functions depend on the regime state of the system, and they 
may not be monotone if the drift coefficients have switching signs. In addition we can 
no longer rely on closed form expressions as in [2] and instead we use PDE arguments, 
cf. e.g. Lemma 4.3, that also simplify the original approach. 

In Lemma 2.1 we write the optimal value of the problem as a function of time, the 
regime state, and the relative maximum of the underlying asset. In the general case 
of real-valued drifts G R, i G A4, we identify the optimal stopping time td in 
Proposition 3.1, and in Proposition 3.2 we determine the structure of the optimal 
stopping set via its boundary functions boit^j) for i in the state space M. of the 
regime-switching chain. 

When the drift parameters (/i(f))iex of the regime-switching chain are nonnegative 
we prove the continuity and monotonicity of boundary functions bo{t,j) in Proposi¬ 
tion 5.1, by extending arguments of [2] to the regime-switching setting. Those results 
are illustrated in Figures 1 and 2 by the plotting of value functions that yield the 
optimal stopping boundaries. 
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In Proposition 5.3 we show that immediate exercise is optimal when all drift param¬ 
eters fi{i) are negative, i E Ai, while exercise at maturity becomes optimal when 
/i(i) > cT^(i) for all i E M, where a(i) are the volatility parameters. 

In Proposition 5.4 we derive a Volterra type integral equation (5.5) which is satished 
by the boundary function boityj) of the stopping set. Such an equation is difficult 
to solve because, unlike in the classical setting [2], it also relies on the knowledge of 
the optimal value function, cf. Remark 5.5. In addition the associated free bound¬ 
ary problem (5.10a)-(5.10b) consists in a system of interacting PDEs that cannot be 
solved without additional assumptions, cf. e.g. Buffington and Elliott [1] for a so¬ 
lution under an ordering condition on boundary functions in the case of American 
options. 

A treatment of drifts coefficients with switching signs has been proposed in 

of [9] via a recursive algorithm that does not rely on a Volterra equation. In this case 
it turns out that the boundary functions bnitA) may not be decreasing in f e [0,T]. 

We proceed as follows. In Section 2 we formulate the optimal prediction problem 
using optimal value functions. In Section 3 we derive the optimal stopping strategies 
in terms of the hitting time of the boundary function of a stopping set. Section 4 is 
devoted to continuity lemmas, which are used to prove the continuity of boundary 
functions. In Section 5 we also derive the Volterra integral equation which is satisfied 
by the boundary functions when the drift coefficients are nonnegative. Finally we 
study particular exercise strategies and we present a numerical simulation of boundary 
functions. 

2 Problem formulation 

Given a standard Brownian motion independent of the Markov chain 

and the filtration (-Pi)teR+ generated by and (/3t)tgR,^, we consider an asset 
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price (ll)teR+ modeled by a geometric Brownian motion 


dYt = iJi{(3t)Ytdt + a{Pt)YtdBt, 0<t<T, (2.1) 


with regime switching driven by a hnite-state continuous-time Markov chain {/3t)t£K+ 
on = {1,2,..., m}, where /i : A4 —?■ R, and a : M —)■ (0, oo) are deterministic 
functions. In this paper we deal with the optimal prediction problem 




inf B 

t<T<T 


sup 

o<s<r 





( 2 . 2 ) 


introduced in [2] for geometric Brownian motion, in which the inhmum of expected 
values over all (^*)sg[t^r]-stopping times r minimizes the “regret” of the stopping de¬ 
cision, where Ql := a{Br — Bt^ jdr : t < r < s), s E [t,T]. 


The next Lemma 2.1 shows that the optimal value function V) in (2.2) can be written 
as a function of (f,/S*, i where Lq,* is dehned by 

Yt,s ■= max Yr, 0 < t < s < T. (2-3) 

’ t<r<s 

Lemma 2.1 The optimal value function V) in (2.2) takes the form 

Vt = V{t,Yo,t/Yt,(]t), 


where the function V : [0,T] x [1, -Tcxd) x A1 —)■ R+ is given by 


V(t,x,j) = inf E 

^ ' t<T<T 


— max ( xYt, Yt^r 


I3t =j 


0<t<T,x>l,jEM.. 

Proof. Given t G [0,T], using the drifted Brownian motion 

p ■= + r ^ 

we rewrite the solution of (2.1) as 

Ys = Yiexp(J a{l3u+t)dBl] . 


(2.4) 


(2.5) 
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and define 


Sl:= sup / (T{/3u+t)dBl^, se[0,T-t]. 

0 <r<s Jo 

By the definition of Yt^s in (2-3) and expression (2.5), and from the conditional indepen¬ 
dence of with Bt given (3t we have, for any (^*)^6[i,T]-stopping 

time r with values in [t, T], letting aV b = max(a, b), 


Ys 

sup — 

0<s<T It 




= E 


Yo,t ^ Y,,t 






= E 

= E 

= E 

= E 


YeL frY{^u+t)dBi j ^ g4_,-/;-V(/3„+t)ds* 
Yt 

Ym q- frY(fiu+t)dBi j ^ g4_,-/;-V(/3„+t)ds* 
Yt 


Tt 


3 


Y),t V Yt^T 


3 


y max ( xYt, Yt^r 


fdt 


J x=Yo,tlYt 

where the last line follows from the conditional independence between Yo^t/Yt and 


Yr YtT 


Yt' Yr 


= exp 


f*T — t 


r*T—t 


a{l3u+t)dBl ,exp S'^_j - / 


given I3t. Therefore by definition (2.2) and expression (2.4), we obtain 


Vt = inf E 

t<T<T 


= inf E 

t<T<T 


Ys 

sup — 
0<s<r 


Bt 


— max ( xYt, Yt^r 


A 


J x=Yo,tlYt 


= v\t^,p„ 


□ 


In the next lemma we rewrite the optimal stopping problem (2.2) in the standard 
form (2.7) below, using the function 


G(f, X, i) := E max yx, Yt^r/Yt 
with G(T, x,i) = X, X > 1. 


A = i 


, t e [0,T], i e A4, x > 1, (2.6) 
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Lemma 2.2 The function V : [0,T] x [l,+oo) x Ai ^ R+ defined by (2.1) admits 
the expression 


t<T<T 

fort e [0,T],j G Ai,x > 1, where 


V{t,x,j)=ME G{T,Xl’fi/3r) 


fit = j 


(2.7) 


:= ^max (^xYt,Yt,r^ , r e [t,T], x>l. (2.8) 

Proof. By a conditional independence argnment as in the proof of Lemma 2.1, for 
any s G [t,T] we have 


lo,T 

Xs 

= E 

Eo,s V Yg^T 
Ys 

Xs 



= E 

Eo,s V Ys^t 
Y s 

%,s 

Ys 



= E 

yy ^ fi 

s 


L -I y=%.s/Ys 


(2.9) 


Next, we extend the above relation (2.9) to (^g)sg[t,T]-stopping times r written as the 
limit of a decreasing seqnence of discrete stopping times by checking that for any 
discrete {gl)s(.[t,T]-stoppmg time r = X)r=i Si ,--An e [t,T], n > 1, by (2.9) 

we have 


17 


0,T 


K 


Xr 




i=l 


E^ 


i=l 

n 


17),T 

~Yr 


Yr 


l{'r=Si} 


E® 


i=l 

n 


0,T 

lo,r 

Y 


l{'r=Si} 


Xr 




Xs. 




{r=Si} 


l,„„l 

i=l \ Si / 


En. 


= G\Tr-^,fir 
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Taking the conditional expectation E[ ■ \ I3t = j,Yo^t/yt = x] on both sides of the 
above equality, we obtain 


Yr 


0,T 




Pt= = X 


= E 


G 


Yr 


r, 


0,r 




,/3r 


Pt=J,^=X 


( 2 . 10 ) 


By (2.8) and the conditional independence between Y^^t/Yt and [Yt/Yr-, Yt^^-jY^ given 
A = 3 we hnd 


E 


— max ( xYt, Yt,T 


/3t = j 


= E 


Yr 


0,T 


K 


Pt= J,^ = X 
It 


= E 

= E 
= E 


Glr,^,/3r 


Yr 


Pt= J,^ = x 




K 


f5t= j,— = x 

it 




A =3 


which completes the proof by (2.4). 


( 2 . 11 ) 

□ 


3 Stopping set and boundary functions 

In this section we apply Corollary 2.9 in [11] in the framework of the regime-switching 
model (2.1) with /i(i) G R, i G A4, in order to specify the stopping set and optimal 
stopping time associated to the optimal stopping problem (2.2), cf. Proposition 3.1 
below. In order to deal with the existence of an optimal stopping time for (2.2) 
rewritten as (2.7), we dehne the set 

^ := {(Ca;,j) G [0,T] X [1,CX)) X : V{t,xJ) = G{t,xJ)}. (3.1) 

From the relation V{T,x,j) = G(T,x,j) = a;, j G Ai, x > 1, we check that {T} x 
[1, cxd) X A4 c D, which is consistent with the fact that the inhmum in (2.2) is over 
msem -stopping times r G [t,T]. 
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Proposition 3.1 Let t G [0,T]. Given I3t = j & M. and = x G [l,C)o), the 

-stopping time 

TD{t,x,j) := inf |r > t 

is an optimal stopping time for (2.2), or equivalently for (2.7), provided it is a.s. 
finite. 

Proof. By Corollary 2.9 in [11] the optimal stopping time for problem (2.7) exists 
and is eqnal to TDit,x,j) in (3.2) provided we check that for all t G [0,T] we have: 

a) G{t,x,j) is lower semicontinnons with respect to x, as follows directly from the 
dehnition (2.6) of G{t,x,j). 

b) V{t, x,j) is npper semicontinnons with respect to x, as follows from the continnity 
Lemma 4.5 below. 



G D 


(3.2) 


c) We have B [snpj^g^^g-p |G(s, /ls)|] < (X). Indeed, from (2.8) and (2.5) we have 

^ max Ft,,) 

^ ^max(logx,SGt)-fo~Y(g^+t)dBl^ SG[t,T]. (3.3) 

Hence by (2.6) and the conditional independence between X*’^ = max ^xYt/Vs, Yt,s/Ys 
and Ysy/Ys given /!,, we hnd that 

I ^ 

■w-t.X 

-I y=Xs' 


G{s,Xl^\Ps) = E 

Y 


yy 


K 


Xt x y 


s,T 


F 




= E 
= E 


— gmax(loga;, S^_j)-/p ^ cr{p^+t)dBi | 


-fo F(/9„+t)(iS* /gmax(log3:,supt<,,<,, /7 * o-(/3„+t)dBf) y ^sup„<,,< j,/J" ‘ (T(/9„+t)(iS‘ 


/3s, X^’ 

(3 


Letting 


nt 

^T-t 


f*s — t 


= inf 


a(Pu+t)dBl 


(3.5) 















= inf 

t€s€T 


ps—t ps — t 

I a{l3u+t)dBt+u+ {iJ,{/3u+t) - cr‘^il3u+t)/‘2)du 
L^'O Jo 


we conclude that 


E 


sup |G(s,X‘’^,/?,)| 


< xE 

< xE 


= E 

sup E 

^max(loga;, * o'(/3„+t)dBf 



t^s^T 




sup E 

t^s^T 






t,x 

s 


sup E 

t<s<T 


g^T.t-inft^r^T /o’’"* cr{P-a+t)dBl 




= xE 

= xE e^T-t-^T-t 


<x\lE E e 


.-25‘ 


maxigvK \a'^(i)-2^l{i)\{T-t) 


E 




< xE 

< oo. 


oct 

^zor-t 


(3.6) 

□ 


Define 

FiJ^x.j) :=V{t,x,j) -G{t,xJ) < 0, (3.7) 

which is nonpositive by (2.7), t G [0,T], j G A^, a: > 1, so that we have 

^ = {(^A, j) G [0,T] X [l,cx)) X A1 : E{t,x,j) =0} , 

hence D is closed from the continuity of {t, x) \— )■ V{t, x, j) and {t, x) \— > G{t, x, j) on 
|o,r] X [1, oo), cf. Lemmas 4.5 and Lemmas 4.6 below, respectively. The continuation 
set C = is an open set that can be written as 

C = {(^,3:,j) G [0,T] X [l,oo) X A1 : F(f,a:, j) < 0} . 

In the next Proposition 3.2 we characterize the shape of the stopping set D dehned 
in (3.1) in terms of the boundary function b^itG) dehned by 


boitj) := inf{a: G [l,oo) : {t,x,j) G D}. (3.8) 
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From the relation {T} x [1, oo) x A4 C D we deduce the terminal condition bD{T,j) = 

1, j e M. 

Proposition 3.2 For any {t,x,j) G [0,T] x [1, cxd) x Ai such that {t,x,j) & D we 
have 

{t} X [x, cx)) X {j} C D. (3.9) 

and 

D = {{t,yj) e [0,T] X [l,oo) X M ; y>bD{tJ)}. (3.10) 

Proof. Let y := sup{ 2 ; G [x, cxd) : {t} x [x, z] x {j} C D}. If y < oo then we have 
it,y,j) G D by the closedness of D, and from the monotonicity property of F{t,x,j) 
stated in Lemma 3.3, {t,y,j) ^ D admits a right neighborhood of the form 

{t} X [x,X + 7]] X {j} C D 

for some rj > 0, which leads to a contradiction. Hence y = +cx) and (3.9) holds. 
Relation (3.10) follows from the equivalence 

(f,x, j) G D {t} X [x, cx)) X {]} C D X > boitj) 


that follows from (3.8). □ 

The following lemma has been used in the proof of Proposition 3.2. 


Lemma 3.3 For any {t,x,j) ^ D, we have 


lim inf 

£\0 


F(t,x + £,j) - Fit, X A) 
e 


> 0 . 


Proof. We split the proof into two parts. 
(i) From (3.4) we have 


(3.11) 




XfX y 




s,T 


K 




= E 


XfX y 








= E 


^max(log3;, 5y_j)-/Q ‘ o-(/3u+t)dh* 




, sG[f,T], 


which extends to any (^*)sg[t T-j-stopping time r G [t,T] as 


G(r,X*’^/?.) = E 


^max(loga;, 5^_^)-/J' ^ a{l3u+t)dBl 


Xr 


(3.12) 
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as in (2.9)-(2.10) above. For all x > 1 and £ > 0, consider the (^*)se[t,T]-stopping time 

Te ■= rD{t,x + e,j) e [t,T] 

defined by (3.2), which solves the optimal stopping problem 


= E 


G(r+,x!’r^/3.) A = j 


V{t, x+e, j) = inf E G (r, (3t = j 

cf. (2.7). The following argument relies on the fact that for any {t,x,j) & D we have 

limToitiX + e,j) = t, (3.13) 

£->0 

as will be shown in part (n) below. Relations (2.6), (2.7), (3.12) and (3.13) imply 
V{t,x + e,j) -V{t,x,j) 


G(r+, /3 .) - G(r/, X":, /? .) | A = J 


+ 


E 


^log(x+£)vS|,_4-/7® * ^iPn+t)dBi _ \ogxVS^_^-fg^ G{l3u+t)dBl 




Jog(x+£)VS^_j-/J'® cr(^„+t)d_B* _ loga:V5^_j-/7= a{liu+t)dBi 


A =3 


(3t = j 


lim inf 

£\0 

> lim inf-i? 

£\o e 

= lim inf-i? 

£\o e 

= lim inf-i? 

£\o e 

= lim inf -E 

£\o e 

_ gmax(loga;,Sy_j) 

dx L 
dG, 

hence we conclude to (3.11). Here we used the dominated convergence theorem with 
the bound 

1 _ , ... 

£ 


A = J 


glog(a;+£)VS^_j _gloga:V5^_^ 

I3t=j 


(3.14) 


glog(x+£)V5|,_^-/7‘" a{l3u+t)dBi _ ^logxVS!^_^-fg^ (7{l3u+t)dBi 


< 


3 log(a;+£) _ logx 




where is defined in (3.5) and the righthand side is integrable as in the derivation 
of (3.6). 

{a) We turn to the proof of (3.13). From the expression (2.4) in Lemma 2.1, we have 

'xYt V Yt,T 


V(t,x,j)= inf E 

^ ' t<T<T 


Y^ 


Pt = j, 
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= inf E 

t<T<T 


e- Jo' ‘ (x V e^r-‘) I3t=j, T, 


(3.15) 


From (3.15) and 


Xt^,x+e ^ /; * a(,3^+t)dBi ( 3 , + ^ V e^‘-0 


cf. (3.3), we obtain 


i/(r,X;’"+",/3,) = inf E 

^ r<T<T 

= inf E 

r<r<T 


Er 


<^iE+r)dBl (^y y j 

3 ~/o ^i0u + r)dB'^ ^J^t,X+£ y ^ 


y=xE+^ 


Er 


(3.16) 


Next, from the definition (3.2) of Toit^x + e, j) and (3.16) we have, on the event 

{A = ill 


= inf ir > t : inf 

r<T<T 

< inf > t : ini E 

r<r<T 

< inf {r >t \ mi E 

r<T<T 


Er 


= E 




rD(t,a; + e,j) = inf{r > f : (r,/3r) G F>} 

g~ /o '^ildu+r)dBl^ ^J^t,X+£ y ^ 

|i~ fo <^Wu+r)dBJi^ V ) 

3 - fo~"^ (T{Pu+r)dBl V e'^T-r j 

where we applied the inequality 

^t,x+£ _ a{Pu+t)dBi ^glog(x+e) y gS*_t ^ < q- fo~* ^(E+t)dBi+£ ^ glog(x) y gSf _t j X*’^, 

a: > 1, £ > 0, r G [t,T]. This implies 


(3.17) 
E, 


Er 

bq 

Al 

^t,a:+£ ^ 

Er 

Er 

>EE 

Xtyx y 

Er 


limr^(f,x + e,j) 

e-s-O 


< lim inf < r > t : inf E 

e—1-0 r<T<T 


= inf < r > f : inf 

r<T<T 

= inf <( r > f : inf 

r<T<T 


-fo '’^iE + r)dB^ V e^T-r j 

- IE" C7i/3u+r)dE V e'^7-r- ) 

- fj~" HE+r)dE V e^T-r ) 


Er 


>E E 


XtyX y ^SJr_x 


(3.18) 
E, 


Er 

> E 

X*’^ V e^7-. 

Er 

Er 

= E 

X*’^ V e^T-r 

Er 


= mi{r>t : (r,X*’*,/S^) G £>} 

= t, 

since {t,x,j) ^ D, E = j and Xj’^ = x. Since rD(f, x + e, j) >twe conclude to (3.13). 

□ 


(3.19) 
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4 Continuity lemmas 


The following property of smooth ht, namely the continuity of the function y i— > 
dV 

-T^it,y,j) over the optimal stopping boundary dC, will be needed in the proof of 
dy 

Proposition 5.4 below. 

Lemma 4.1 For any {t,y,j) G dC, y > 1, we have 

dV, dV, 

Proof. For any e G {0,y — 1), let rf = TD{t,y — e,j) G [t,T], cf. (3.2). Since 

ifiUii) £ dC and D is closed we have {t,y,j) G D. Similarly to (3.17) to (3.18), t~ 

converges to t a.s. when e: tends to 0. By the same approach as in (3.14), replacing 

y + e with y — e shows that 

dG . fV{t,y-e,j)-V{t,y,j) 

< limmf-. 

oy £\o £ 

On the other hand, since it,y,j) G dC C D, we have 

,. y{t,y-e,j)-V{t,y,j) G{t,y - e,j) - G{t,y,j) dG 

hmsup- < hm-= j-{t,y,j), 

6\o £ ^\o e dy 

hence 

dV dG 

Finally the fact that 17 = G on the closed set D implies 

dV, dV, dG, 


□ 


In the next proposition, which will be used in the proof of Proposition 5.4, we show 
the normal reflection of the free boundary problem by proving that the right derivative 
of the value function V(t,y,j) vanishes ai y = 1, cf. also page 264 of [11] without 
regime switching. 

Lemma 4.2 For any t G [0,T] and j & M. we have 

dV 

^(u+.a = o. 
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Proof. For convenience of notation we set tq = 1, j), and note that 

1 + £,i) 


lim sup 

£\0 


1 


log(l+£)vS^_,-/o"“ V(/3t+,)dK 


TQ-t 


< lim sup -E[G{tq, - G(ro, I A = i] 

£\o 

= lim sup -E 
£\0 £ 

= lim sup E 

£\0 


A = J 


i /glog(l+£)v4_,-/o"° ^a{Pt+r)dBl ^ a{Pt+r)dBl.\ 


= E 

= 0 , 


£ 

glog(l+£)vS^_,-/J'o-* <T(/3t+,)dSj 

lim sup-1 

£\0 £ 


{'S'r_t<log(l+£)} 


A = 


{S^_j<log(l+£)} 


A = J 


since lml|g^ <iog(i+£)} ~ 0’ where we applied the dominated convergence theorem 
as in the proof of Lemma 3.3 with the same dominating function as in (3.15). Since 
V(t,y,j) is nondecreasing in y E [1, oo), we have 

> 0 , 

£\0 £ 


which shows that 


dV 

dy 


(^, i+,i) 


lim ^(^A + g,j) 

£\o e 


0 . 


□ 


Next we consider the infinitesimal generator 

/ o (9 1 (9^ \ ^ 

^ ' i=l 

(4.1) 

of the Markov process {s, Xl’^, (3s)seit,T], where Q = {qij)i,j=i,...,m is the infinitesimal 
matrix generator of the Markov process (A)ie[o,T], for any sufficiently differentiable 
function / of {s,y,j) G [0,F] x [1, cxd) x Ai, cf. Lemma 4.7 below. 


The following lemmas will be used in the proof of Proposition 5.3 below. In Lemma 4.3 
we replace the use of closed form expressions for hG{t,x,j), which are no longer 
available in our setting, with the differential expression (4.3). 
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Lemma 4.3 We have 


and 


dG 

1+) j) = 0, t e [o,T], 


dG 


(4.2) 


hG{t,x,j) ^ xa (e|0,T], (4.3) 

with hG(T,x,j) = —h^{.j)x, j G A4, x G [l,C)o). In particular, for any (t,x,j) G 
[0,T) X [1, oo) X Ai we have 


(4.4) 


hG{t,x,j) > 0, when fi{j) < 0, 

hG{t,x,j) < 0, whennij) > 

In addition, l^G{t,x,j) is nondecreasing and continuous in t for all x > 1 when 

M > 0 . 

Proof. For all j G we let 


f{t,y,z,j) := yG{t,-,j] = E 


Y, 


max z, y- 


t,T 


Y 


I3t = j 


, tG[0,T], y,z>t). 

(4.5) 


By (2.1) and the ltd formula we have 

dl 
dt 


df{t, Yt, Fo,o A) =%{t, Yt, Fo,t, Pt)dt + M)Yt^{t, Yt, Fq.o Pt)dt 


df - 1 d‘^f 

+ a{/3t)Yt^{t, Yt, Yo,t, f3t)dBt + -a^{^t)Yt^^{t, Y, Fo,o /3t)dt 


dx"^ 


df 


+ ^ {t, Y, Yo,t, /3t)dYo,t + f{t, Y, Yo,t, A) - f{t, Y, Yo,t, /3t-), 


and given that 


f{t, Y, %,t, fit) =E[ Yo,t I A, Y, Yo,t ]=E[Yo^t\ At], t G [0, T], 
is a martingale and (^o,i)jg[oT] finite variation, we find 

^i't,y,z,j) + yij)y^{t,y,z,j) + ^a^{j)y^^{t,y,z,j) + '^qj^if{t,y,z,i) = 0 , 

(4.6) 
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df 

and -^it,x,y,j)x=y = 0. Substituting (4.5) into (4.6) shows that 

(*• y’^) + (*■ -y’^) + *' 1 ^ (*■ -y'^) H 


1 


fdG 


\dx \ ' y 


^(lj,iyG = 0 , 


+ U- t, J t, J + 


2 dG 


d‘^G 


y^ dx \ ' y' J y^ dx"^ \ ’ y 


t, -,J 


2 = 1 


which shows that the function G{t,x,j) satisfies the PDE 
dG dG 1 d^G 

y{j)G{t, x,j)+ — {t, x,j)-y{j)x—{t, x,j)+-a^{j)x^ — {t, x, j)+^ qj,iG{t, x, i) = 0, 


dx 


dx'^ 


2=1 


and we conclude to (4.3) by (4.1). Next we note that (4.2) follows from 

A=j)<l, (t,x,j) e [0,T] X [l,oo) X Al, (4.7) 




< X 


cf. the definition (2.6) of G. Next, by (2.6) and Lemma 4.3, for any {t,x,j) G 
[0, T] X [1, oo) X Al, we find 


LG'(t,x, j) = xa\j)P I ^ < X 


Y, 


= E 


= E 


xcr (j)l{y,_^/y,<,} -/i(j) 


A = J 1 - y{j)E max (X, 17 ,t/A 
Yt,T 


Pt =j 


Yt 

f3t =j 


f3t = j 


E 


h(i) I ^ V j l{y, 


(4.8) 
A = J 


which shows (4.4), and implies by (4.8) that LG(t,x,j) is nondecreasing and contin¬ 
uous in t e [0,T] when fi{j) >0. □ 

The proof of the next lemma, which will be used in Proposition 5.3 below, extends 
the argument of [2] page 993 to the regime-switching setting. 

Lemma 4.4 lAe have 

{(t,x,j) e [0,T) X [1,cxd) X A1 : LG(t,x,j) < 0} C C, 
where G = is the continuation set. 
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Proof. By Lemma 4.7 below and Lemma 1 in [15] we have 


I A = j] = G{t,x,j) + E 


EG{r,Xf^,(3r)dr 


fdt=J , 


(4.9) 


.J t 

s G [t,T]. Assnme now that (t, x,j) G [0, T) x [1, oo) x Ad is snch that hG{t, x,j) < 0. 
By the continnity of hG(t, x,j) with respect to t, there exists an open neighbonrhood 
U C [0,T) X [1, oo) of {t,x) snch that hG{s,y,j) < 0 for all {s,y) G U. Replacing s 
in (4.9) with the hrst exist time tu of U when {X^'^l3s)se.[t,T] is started at (a;,j) at 
time t, Relation (4.9) above shows by optional sampling that 

rnj 


E[G{Tu^K^:f^^ru) I (it =3] = G{t,x,3)pE 


LG'(r,X*’",/3,)dr 


A =3 


.Jt 

Since tu > t a.s. and LG(r, XA,A) < 0 when r G (t,Tu), the right hand side is 
strictly smaller than G{t,x,j), while we have 


E[G{Tu,Xf;;,f3ru) I (it =3] > V{t,x,j), 

showing that V{t,x,j) < Git,x,j), which implies that {t,x,j) ^ G. □ 

Next we derive the following continnity resnlt wich has been nsed in the proof of 
Proposition 3.1. 


Lemma 4.5 For any j G M., the mapping {t,x) i —> V(t,x,j) is jointly continuous 
on [0, T] X [1, oo). 


Proof. We proceed in two steps, (i) We show that the mapping t \—> V(t,x,j) is 
continnons on [0,T] for every hxed x > 1 and any j G Ad. By (2.4) we have 


V{t,x,j) = 


inf E 

t<T<T 


jxYt) V Yt,T 


(it = 3 


inf E 

0<r<T-t 


= inf E 

0<T<T-t 


max {{fi.{f}r)-P{ISr)/2)r+cr(Pr)Br) 
X V eO<r<T-t 

piuihp-o-^ Gt)/ 2)T+cr{l3r)BT 


(io =3 


U{t,T) 


(io = 3 


, t G [0,T], j G Ad, X G [l,oo), 


where 


max ({p(l3r)-Pil3r)/2)r + CT{Pr)Br) 

^ \y Q 0 <r<T—t 

G{t,s)-.= {^,{0,)-a^{0,)/2)T+aiys)Bs ’ S,te[0,T]. 
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For any (^*)se[i,T]-stopping time r G [0,T — t] we have 


0 < E 


f/(t, r) - t/(t + s,t) 


l3o =j 


< 


\ 


E 


max {(fi{f)r)—cr'^i0r)/‘2)r+cr{l3r)Br) max {{fi{/3r)—u'^{f3r)/2)r+cr{/3r)Br) 


— e 


0<r<T—t—s 


/3o =J 


r~ 


-l 


Q-2{^l{l3-r)-cr'^{l3-r)/2)T-2a{l3r)BT 

o 

1 


< 


\ 


E 


max {{fi{l3r)-(j'^{l3r)/2)r+cr{l3r)Br) max {{fi{l3r)-ij'^{f3r)/2)r+cr{/3r)Br) 


— e 


0<r<T—t—s 


/3o =J 


(T-pmax|3(T(i)-2/x(j)| 

X We 


^ — 2u^{l3r)T — 2u(lir)Br 



< 


\ 


E 


max {{^{l3r)-a'^{lir)/2)r+a{l3r)Br) 


— e' 


max {{fi{/3r)-iJ^{f3r)/2)r+a{/3r)Br) 


0<r<T—t—s 


{T—t) max \2>(7(i)—2^(i)\/2 

X e 


fio=j 
(4.10) 


where we applied the optional sampling theorem. Letting s tend to 0 on both sides 
of (4.10), we get 

lim E[U{t + s, t) \ Po = j] = E[U{t, r) | /?o = j], 

and since the convergence is nniform on all (J^s)se[o,T]-stopping times r G [0,T], we 
obtain 

liminf inf E+ s,r) I/do = j] > hminf inf E\U(t + s,t) \/3o = j] 
= inf lim id rf/(f + s, r) I/do = j 1 = inf E\U{t,T) \ = j]. (4.11) 

0<T<T-ts\0 / I f-u JJ 0<T<T-t L V 1 / I f-u JJ V y 

Next, according to Proposition 3.1 there exists an optimal (J^s)se[o,T]-stopping time 
W € [0, T — t] snch that 


itif E[U{t,T)\li„ = j]=E[U{t, r,-) I A = j ], 

U<-T<.J —t 


(4.12) 


hence we have 
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< E[U{t,T; MT-t-s))\P,= 3 ]. 
Since U{t,s) is nonnegative for any s,t E [0,T], we have 
U{t,T* A{T -t-s)) < U{t,T;) + U{t,T -t-s) 

= u(,t,T;) + 


max {{^j,{l3r)-cr^il3r)/‘2)r+a{/3r)Br) 

X V 


< U(t,Tl) + 


max cr2(/3r)/2)r+(T(/3r)-Br) 

X V 

inf (ii(i)—cr‘^{i)/2)r-\- inf ((7{i)Br) ’ 


which is integrable by (4.12). By the reverse Baton Lemma we have 

lim sup E \U{t, A {T — t — s)) | /So = j] < sup U{t, A {T — t — s)) | /So = j] 

s\0 s\0 


= E[U{t,T:)\(3o = j]. 

Combining (4.12), (4.13), (4.14) and (4.11) we hnd 


(4.14) 


lim inf E 

s\0 0<T<T—t—s 


U{t + s,t) 


Similarly we have 


lim inf E 

s\jO 0 <T<T—f+S 


U{t 


S,T 


^0 =j 


/3o =j 


= inf E 

0<r<T-t 


= inf E 

0<T<T-t 


U{t,T) 


U{t,T) 


l3o =j 


l3o =j 


hence t \—> V{t,x,j) is continuous on [0,T]. 


(a) We show that x \—> V{t,x,j) is continuous on [1,cxd), uniformly in t G [0,T], 
extending the argument of [2] page 995 to the regime-switching setting. By Rela¬ 
tion (4.7) and the mean value theorem, for all y G [x, oo) there exists a (random) 
rj G such that for any (-Bs)se [o,r]-stopping time r G [0, T — t] we have 


G{t + r, A+.) - G{t + r, A+.) = ^(t + r, /S,+.) 


^t.X 


dG 


t,y 


rt^X 


< {y-x) 


dx 
Yt 

Yt+Y 


(4.15) 


since Xlf^ — Xl’^^ < {y — x)Yt/Yt+T by (2.8). Let now {t,x,j) ^ [0,B] x [1, cx)) x Xi 
and consider := T(t,x,j) given by (3.2). By Lemma 2.2 we have 

Vit,y,j) -V{t,x,j) < E [G{t + T^,Xlf^^,l3t+r^) - G(t + r^,,| A = j] . 

(4.16) 
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Since | /3t = j] is uniformly bounded as in (3.6), taking expectation on 

both sides of (4.15) yields 

lim E [G{t + r, f3t+r) - G{t + r, f3t+r) \ f3t = j] = 0, 

y^x 

uniformly in f G [0,T] and in the (Xs)sg[o,T]-stopping times r G [0,T 
V{t,x,j) is increasing in a; G [1,cxd), (4.16) and (4.17) yield 

0 < \im{V{t,yJ) - V{t,xJ)) < 0, 

y^x 

which shows the continuity of x i—)■ V{t,x,j), uniformly in f G [0,T], for all j G XI. 


(4.17) 

t]. Since 


From (i) and (ii) we conclude to the joint continuity of {t, x) \—> V{t, x,j) on [0, T] x 
[1, oo) by classical arguments. □ 


Lemma 4.6 The mapping {t, x) \—)■ G{t, x,j) is jointly continuous on [0, T] x [1, cx)). 

Proof. By Relation (4.7) and the mean value theorem, for all y G [x, oo) there exists 
an 7] E [x,y] such that for any f G [0, T] we have 


0 < G{t,y,j) -G{t,x,j) 


{y-x) 


dG 

dx 


<y-x, 


which shows the continuity of x i —> G{t,x,j), uniformly in f G [0,T]. On the other 
hand, we have by (2.6) that t i —> G{t, x,j) is continuous on [0, T] for every x > 1. We 
conclude to the joint continuity of (t, x) \—> G(t, x,j) on [0, T] x [1, oo) by a classical 
argument. □ 


We close this section with the following lemma. 


Lemma 4.7 The Markov process {s, ,/3s)s£[t^T] hf^s the infinitesimal generator 

/ f) (9 1 ( 9 ^ \ ^ 

L/(5,|/,j) = 

s G [0,T], j e M, y e [l,oo), for f G Dorn (L) satisfying ^{s,l+,j) = 0. 
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Proof. Letting 


S — t 


zr ■.= \ogxysU- 


a{l3u+t)dBl, 


s e [t,T], X > 1, from (3.3) we have = exp(Z*’^), s G [t,T], x > 1. Since 
(5*)re[o,T-t] is nondecreasing it has hnite variation, hence 

= a^{(5r){dBl_^,dBl_^) = a\/3r)d{Br, B^) = a\/3r)dr, 


which shows that 


1 


dxf^ = Xl'^dZf^ + -XYdlfZY, zY) 

= X'fdZ'f + * 


1 


= X‘--d(logx V S\_,) - a{f^s)Xl’^dBU + -a\MXl^^ds. (4.18) 

Given that |^(s, l+,j) = 0 for {s,y,j) G [0,T] x [l,oo) x Xi, we have 

^(s,X‘f,D,)d(logxVSl,) = ^(s,Xp.A)l„,.,.^„ci(logiVSi_,) 


dy 

= 0 , 


since d{\ogx V Sl_f) = 0 when Zl’^ > 0, s G [t,T]. From (4.18) this shows that 
^{.s,X<f,P,) dX‘f = A) (-a(p,)X‘,^dBl, + \!THfi.)X‘/‘dr'\ , 

and we conclude the proof by ltd’s calculus. 


□ 


5 Solution of the free boundary problem 

In this section we turn to the solution of the free boundary problem (2.4). We start 
by providing sufficient conditions on the drift coefficients {y{j))j^M for fhe boundary 
function boit^) dehned by (3.8) to be nonincreasing and continuous in t G [0,T]. 
The next proposition 5.1 relies on Lemma 5.2 below. 
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Proposition 5.1 Assume that ^{j) > 0 for all j G M.. Then the boundary function 
boityj) defined by (3.8) is nonincreasing int E [0,T] and continuous int E [0,T], for 
all j E M.. 

Proof, {i) Monotonicity. Let (t,x,j) E D and s E [t,T]. We have F(t,x,j) = 0 and 
F{s,x,j) = 0 since F{t,x,j) is nondecreasing in t by Lemma 5.2, hence 

[t,T] X {x} X {j} C D, 

showing that {t,x,j) E D [t,T] x {x} x {j} C D. Then for any s E it,T], we 
have {s,bD(t,j),j) E D since (tjboit, j), j) E D. By Proposition 3.2 and noting that 
(s, 6d(s, j), j) e D, we conclude that boisj) < hoitj). 

{ii) Right continuity. Given (t, hoit^ j)., j) E D, consider a strictly decreasing sequence 
(tn)n>i such that lim = t. By part (f) above we know that boitnjj) < hoit^j), 

n^oo 

n>l, and lim b£)(tn,j) < boit^j). Next, by Proposition 3.2 we have 

n^oo 

[t,T] X [bD{t,j),oo) X {j} C D, 

and since {tmj,bD{tmj)) G H, n > 1, and D is closed, we have (t, lim boitn, j), j) G 

V n^oo J 

D, hence lim boitnj) > boit^j). 

71^00 

{Hi) Left continuity. Using Lemma 4.4 we can repeat the argument of [2] page 998 
provided we show that the function h{t,j) dehned by 

h{t,j):=mi{xE[l,oo) : hG{t,y,j)>0, V?/G [x, cx))}, (5.1) 

is continuous in f G [0, T] for all j E M, with h{T,j) = 1- By Lemma 4.3 the function 
L,G{t,x,j) is nondecreasing in t for all x > 1 since {j) > 0 and it follows from the 
dehnition (5.1) of h{t,j) that t i —> h{t,j) is nonincreasing in f G [0,T]. For any 
to E [0,T) and decreasing sequence (tn)n>i C {to,T] converging to from the righthand 
side we have lim h{tn,j) ^ b,{to,j) and lim h{tn,j) ^ b,{tk,j) for any k > 1, hence 

n^oo n^oo 

lim h{tn,j) ^ h{toG) as by the continuity of f —)■ LG(t,x, j) we have 
LG(to, lim h{tn,j),j) = lim LG(4, lim h(4, j), j) > 0, 

n^oo k—^oo n—¥oo 

and this proves that lim h{t,j) = h{to,j)- On the other hand we have h{to—,j) ■ = 

t\to 

lim h{t,j) > h{to,j) for any 4 e [0,T], j E M. In case h{to-,j) > h{to,j) we 
Pio 
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have LG(to,a;,j) > 0 for all x E [h(tQ,j),oo]. In addition, for any t E [0,fo) and 
X E [h{to,j),h{to—,j)) we have hG{t,x,j) < 0 since h{t,j) > hence 

hG(to,x, j) = 0 for all x E [h(to,j),h(to—,j)) by the continuity of t \—> hG(t,x,j). 
By Lemma 4.3 we would have 

dG 

= lx{j)G{to,x,j), X E [h{to,j),h{to-,j)), 

which shows that G{to, x,j) = C{tQ, where G{tQ,j) depends only on to and 

j E A4. This is a contradiction since ^G(tQ,x,j) = P (Yt^^x/yto < ^ \ (^to = = 

C(to, ^ ^ ^(^0—,i)) cannot hold when p(j) < 

and more generally Yto,T/yto cannot have a power law, even locally. □ 

Figure 1 illustrates the result of Proposition 5.1 by applying the recursive algorithm 
of [9] in order to plot the value functions V(t, a,j) and G(t, a,j)- In Figure 1 we take 
the positive drifts /i(l) = 0.15, /i(2) = 0.05, with (t(1) = 0.5, a{2) = 0.3, T = 0.5, 
n = 100, 5n = T/n = 0.05, and 



Figure 1: Value functions in the two-state case. 


Figure 1 also allows us to visualize the stopping set D and the continuation set 

G = {{t,a,j) E [0,T] X [l,oo) X M : V{t,a,j)<G{t,aJ)}. 

The numerical instabilities observed are due to the necessity to check the equality 
V(t,a,j) = G(t,a,j) when V(t,a,j) and G(t,a,j) are very close to each other. 
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1.7 


bD(t,l) 



Figure 2: Boundary functions in the two-state case. 


The boundary functions are plotted in Figure 2 based on Figure 1, with spline smooth¬ 
ing. We observe that starting from state 1 it is better to exercise earlier than if we 
start from state 2 which has a lower drift. This is due to the possibility to switch 
from state 1 to state 2 after the average time l/gi,! = 0.4 and to stay at state 2 for 
the remaining time T — t < l/q' 2,2 = 0.5, in which case the drift takes the lower value 
/i(2) = 0.05. The opposite occurs if we start from state 2, for which the boundary 
graph is higher than if we start from state 1. 

Similarly to (3.22)-(3.23) in [2], we now show that F{t,x,j) dehned by (3.7) is non¬ 
decreasing in t G [0,T] for all j & M. and x G [1, 00 ), as in the following Lemma 5.2 
which has been used for Proposition 5.1, and whose proof follows [2] page 994. 

We note that without the condition /i(f) > 0 for all i G Al, the function F(t,x,j) 
in Lemma 5.2 may not be nondecreasing in f G [0,T], in which case the equivalence 
{t,x,j) G D [t, T] X {x} X {j} C D in the proof of the next Proposition 5.1 
does not hold and in this situation the boundary function t 1 —> boit^j) may not be 
decreasing in f G [0,T], cf. Figure 4 in [9]. 

Lemma 5.2 Under the condition fi{j) > 0 for all j G Ai, the function 

t I—^ F{t, X, j) = V(t, X, j) - G(t, X, j) 
is nondecreasing in t & [0,T], for any (j,x) G x [1, 00 ). 
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Proof. For any r,s G [0,T —t], and r < s, denote Tg := TD{s,x,j) — s E [0,T —s] by 
the definition (3.2) of td- Replacing s with and t with r in the formula (4.9), and 
using optional sampling, we have 


F{r,x,j) = V{r,x,j)-G{r,x,j) 

< E[G{r + Tg, (3r+Ts) I = j] - G{r, x,j) 

I'T+Ts 

hG{v,Xl’^,/3,)dv /3r=j 


= E 
= E 
= E 


Uo 


Uo 


L,G{v + r, Xff^, (3v+r)dv 


I3r = j 


LG'(r; + r, I3.f)dv 


l3o = j 


(5.2) 


Combining (5.2) with 

F{s,x,j) = V{s,x,j) -G{s,x,j) = E[G{s + Tg,Xg'f:^^,f3g+rJ \ Pr =j] -G{s,x,j) 


= E 


hG{v + s,X^’^,P,)dv 


Uo 


/3o =J 


we have 


F{s,x,j) - E{r,x,j) (5.3) 


IV 

/ “LG'(n + s,X°’",/3,)dn 

O 

-E 

[ \G{v + r,X^'J^Jdv 

1- 

O 


Jo 



Jo 

_ 


= E 


hG{v + s, X))’", /?,) - hG{v + r, X))’", ^,)dv 


l3o =J 


uo J 

Since by (4.8) the function 1 1 —)■ L,G{t, x, i) is nondecreasing in t when fi{i) > 0, we find 
that the right hand side of (5.3) is nonnegative, thereby E{t,x,j) is nondecreasing in 
fG[0,T]. □ 


Particular exercise strategies 

Next we show that the stopping set D has a simple form in two special situations. 

Proposition 5.3 We have the following special cases of optimal stopping sets D. 

i) Immediate exercise. Under the condition p,{j) < 0 for all j G Ai, we have 
D = [0,T] X [1, oo) X Ai. 
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ii) Exercise at maturity. Under the condition fi{j) > cT^(j) for all j G A4, we have 
D = {T} X [1,cxd) X Ai. 


Proof. Replacing s in (4.9) with td defined in (3.2) and using optional sampling, we 
find 


V{t, X, i) = G{t, x,i) + E 




hG{r,Xl’^,/3r)dr 


fdt = i 


te[0,T]. (5.4) 


.Jt 

i) In case /i(j) < 0 for all j G Ai, by Lemma 4.3, we have hG{t,x,i) > 0 for all 
(t,x,i) £ [0,R) X [1, oo) X Ai, hence (5.4) implies Toit^xA) = 0 a.s., otherwise 
it contradicts the fact that V{t,x,i) < G{t,x,i) because of (5.4). This implies 
[0,T] X [1, cx)) X c D. 


ii) In case /r(j) > cr^(j) for all j G Ai, by Lemma 4.3 we have hG{t,x,i) < 0 
for all (t,x,i) G [0,T) x [1, oo) x Ai, and applying Lemma 4.4, we see that 
[0,T) X [l,oo) X Ai CG, which means D = {T} x [1, oo) x Ai. 

□ 


Finally we derive a Volterra type equation (5.5) below satisfied by the function 
bnityfit) defined in (3.8), for the boundary curves 


{(f,x) G [0,T] X [l,oo) : x = bDit,j)} 


of the optimal stopping set D in (3.1), for any j G Ai. 

Proposition 5.4 Assume that fi{j) > 0, j G Ai. The boundary function bD{t,j) 
satisfies the Volterra type equation 

G{t,bD{t,j),j) = J{t,bD{t,j),j) - K{t,r,bD{t,j),j)dr, (5.5) 

0 < f < T, with terminal condition bD{T,j) = 1, j e Ai, where 

J{t,x,3)-.= E[Xt^^\At=3], (5.6) 

and 


K{t,r,x,j) := E ^hV{r, X^’A Pr)l{xAybn{r,yr)} 
for 0 < t < r < T and x >1. 


A =3 


(5.7) 
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Proof. Noting that V{t,x,j) < G{t,x,j) for all {t,x,j) G [0,7"] x [1, oo) x by 
(2.7), the continuation set C := is given by 


C = D” = {(t,x,j) € [0,T] X [l,oo) X M : 


(5.8) 


According to Proposition 3.1, for any (t,x,j) ^ C, we have 


V{t,x,j) = E 




(3t=j , 


(5.9) 


where Tn = TD{t,x,j) is dehned by (3.2). Given that f^(^, 1+, j) = 0 by Lemma 4.2, 
by the application of [11], Chapter III, § 7.1.1, § 7.4.1 as in [2] § 3.5, page 996, 
the function V in (5.9) is in the continuation set G in (5.8) and it solves the 
Cauchy-Dirichlet free boundary problem 


= 0, {t,y,j)eG, (5.10a) 

[vit,y,j) = G{t,y,j), {t,yj) e dG, (5.10b) 


hence dG C D, where dG denotes the boundary of the open set G. By the local 
time change of variable formula of [10], and by Lemma 4.7 below with the property 
^(f, 1+, j) = 0 shown in Lemma 4.2 above, we have 

B[A'P I A = j] = E[V{T, A'p, M I A = j] 

r rT 1 


= V{t,x,j) + E 

dV 
dy 


_J t 


--E 

2 


hV{r,Xj.’ , 

dV 
dy 


f3t =j 


T ray ay 

— (r,X;’"+,/3,) - _(r,X*’--,/3,) ) 


{X’"=bD(r,/3,)} 


Ml{X^ 


(5.11) 
A =3 


where we applied the equality V{T, X!f^, = X!f^, and (A(A^’*))rg[t,r] denotes the 

local time of on the (piecewise continuous and nonincreasing by Proposition 5.1) 
curve r i— > bD{r, fir). By the smooth £t property shown in Lemma 4.1 above, the last 
term in (5.11) vanishes. By Proposition 3.2 above and the dehnition (3.8) of boitj), 
Relation (5.10a) can be rewritten as 


^V{r,y,j)l{y<boir,j)} = 0, re [0,T], j E M, y>l, 
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which implies 




.J t 


= E 


.Jt 


(5.12) 


Hence, combining (5.11) and (5.12), we obtain 


E[X‘i‘\P,=j] = V(t,x,j)+ / E I A=j 


and substituting x with hDit,j) in (5.13) above we hnd that 


dr, 

(5.13) 


G(t,bn(t,j),j) = V(t,bo(t,j),j) 


= \Pt=j]-E 


LV'(r,.YP“"'^'), I ft = i 


= J{t,bD{t,j),j) - / K{t,r,bD{t,j),j)dr, 


where the functions J, K are dehned by (5.6)-(5.7). 


□ 


Remark 5.5 Note that the equation (5.5) also involves the optimal value function 
o.'iT'd not only the function G{r,y,j). Indeed, when m > 2 the equality 
V{r,y,j) = G{r,y,i) in (5.12) for a given {r,y,j) = (r, /3r) G D does not imply 

^V{r,y,j) = hG{r,y,j) 

as in [2] because we may not have V{r,y,i) = G{r,y,i) for all i = 1,... ,m in the 
summation over the states of {l3t)t&[o,T] the definition (4.1) o/L. In [1] this issue 
is dealt with via an ordering assumption on the boundary functions (^^(t, j))tg[o,r] in 
the two-state case j = 1,2, see Assumption 3.1 therein, however this method applies 
specifically to American options and not to ultimate maximum problems, which have 
a more complex payoff structure. Moreover, such an ordering condition may not he 
satisfied in our current setting, cf. Figure f of [9]. 

In the absence of regime switching with Y) = 1 q Relation (3.8) is re¬ 

placed by 

bD(t) = inf{x G R+ ; (t,x) G D}, t G [0,T], 
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and the boundary equation (5.5) becomes 


G{t,bD{t)) = E[x!^^^‘^^'>]-E 
which recovers (3.50) in [2], with 




d (9 1 (9^ 

LG(r,x) = ( ^ + ) G{r,x), r e [0,T], x e R+. 


Since the Volterra type equation (5.5) cannot be solved by standard methods under 
regime switching, we have applied the recursive algorithm of [9] in order to plot 
Figures 1 and 2. 
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